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■ Many regenerative arguments in stochastic processes use random times which are 

. akin to stopping times, but which are determined by the future as well as the past 

' behaviour of the process of interest. Such arguments based on "conditioning on the 

f"*^ ■ future" are usually developed in an ad-hoc way in the context of the application 

. under consideration, thereby obscuring underlying structure. In this paper we give a 

simple, unified and more general treatment of such conditioning theory. We further 
give a number of novel applications to various particle system models, in particular 
to various flavours of contact processes and to infinite-bin models. We give a number 
of new results for existing and new models. We further make connections with the 
theory of Harris crgodicity. 
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1 Introduction 



> 

\f} | Many arguments in stochastic processes use random times akin to stopping times to es- 

tablish regenerative or ergodic behaviour. These may be randomised stopping times as in 
the theory of Harris ergodicity. Alternatively they may be random times in which there 
^ is an element of conditioning on the, possibly infinite, future of the process of interest, 

but in which this conditioning is sufficiently controlled that, with respect to these random 
times, the process behaves as if they were stopping times; such times are used, for exam- 
ple, in establishing the long-term behaviour of particle systems and population processes 
conditional on their survival, and in establishing the behaviour of processes conditioned 
to avoid given regions of their state spaces. More generally such random times, defined 
by conditioning on future behaviour may also be used to establish the unconditional be- 
haviour of their parent processes — as we illustrate in the applications of Sections 3 and 4. 
Such arguments based on "conditioning on the future" are usually developed from scratch 
and in an ad-hoc way in the context of the application under consideration, thereby to 
some extent obscuring underlying structure. 

Our aim in the present paper is to give a unified treatment of these phenomena. In doing so 
we develop a simple theory which is more general than the sum of those already existing, 
and which has applications — for example to some variants of the models considered in 
Sections 3 and 4 — which cannot be managed by the simple application of such bits of 
theory as already exist. We further apply the results obtained to a number of new models, 
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including variants of the three-state contact process of Section 3 and of the infinite-bin 
models of Section 4. 

For simplicity of exposition we work in this paper in discrete time. In general the process of 
interest {X n } n >Q, say, may be constructed as a functional of an underlying process {£ n }n>ij 
or {£n}nez> where as usual Z is the set of integers. In the present paper we assume that the 
process {£„,} consists of independent identically distributed random variables £ re . However, 
some of the phenomena studied here for the process {^ n } continue to occur under more 
relaxed assumptions for the underlying process {£n}; for example, that it is regenerative. 

In Section 2 we present our basic theory. Our aim is to identify sequences of random 
times < ro < Ti < . . . , the definition of each of which may depend both on the (typi- 
cally infinite) past and on the (typically infinite) future, but which are nevertheless such 
that the segments of the process between successive such times are i.i.d.. Following 
Kuczek [19], we shall refer to these times as break times. 

It is helpful to give an immediate example (in which the dependence is on the future only). 

Example 1. Let {£, n }n>i consist of i.i.d. random variables, with common distribution given 
by 

P(6 = 1) = P 
P(6 = -1) = q 
P(6 = 0) = l-p-g, 

where < q < p and p + q < 1 . We consider three variant constructions of random times 
whose definitions involve conditioning on the (infinite) future. 

(a) For each n > let F n be the "future" event that YliLi ^n+i > for all m > 1. 
Note that the common probability of the events F n is strictly positive. Let < 
To < Ti < . . . be the successive times n at which the event F n occurs. Then it is 
easy to see (and is a special case of the result of Example 2 below) that the successive 
segments {£ Tfc _|_i, . . . , Cr k+1 }, k > 0, of the process {£ n } are independent and identically 
distributed in k. In particular the successive time intervals Tk+i — Tk, k > 0, are i.i.d. 

(b) Now suppose that, for each n > 0, we let F' n be the future event that Y^=x ^n+i > 
for all m > 1 and additionally £, n +2 = 0. Again the common probability of the events 
F' n is strictly positive. Let < t'q < r{ < . . . be the successive times n at which 
the event F' n occurs. In this case we do not have independence of the successive 
segments {£ r £ +1 , • • • , £ T £ 1 }, k > 0; for example, if the events Fq and F{ both occur, 
then necessarily £t{+i =£2 = 0. 

(c) Finally, suppose that the events F' n are as in (b) above. However, define the sequence 
< Tq < t'{ < . . . by Tq = min{n > : occurs} (i.e. t'q = t'q) and, for k > 1, 
t'I = min{n > t' i !_ 1 + 2 : F' n occurs}. Then it is again easy to see that the successive 
segments {£t"+1j • • • , £ r " }> A; > 0, of the process {£ n } are once more independent 
and identically distributed in k. 

The reasons for the different behaviours in the above example is that, in order to obtain 
i.i.d. behaviour, we require the definitions of the successive time to satisfy a form of 
monotonicity condition in which, in a sense which we make clear in Section 2, information 
about the future does not cumulate; this condition is satisfied in the variants (a) and (c) 
of Example 1, but not in the variant (b). In Section 2 we develop the relevant theory 
in a general setting in which the break times may depend on both the past and the 
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future behaviour of the underlying process {£ n }- In particular we give conditions for the 
segments of the process {£ n } between regeneration times to constitute i.i.d. cycles. We 
believe this theory to be novel in the general setting. As a simple example, we apply the 
theory to a general random walk with positive drift (generalising Example 1). 

In Section 3 we give applications of our theory to a number of discrete-time contact process 
models, both showing how existing results are more readily understood, and giving some 
new results for a three-state contact process. The theory is equally applicable in the 
continuous-time setting, and has applications in general to particle systems and similar 
models in which processes "survive" with probabilities strictly between zero and one. In 
Section 4 we give applications of the theory of Section 2 to a class of "infinite-bin" models. 

In Section 5 we make some new connections with existing theory of Harris-ergodic Markov 
chains. Finally, in Section 6 we discuss a number of other models and extended appli- 
cations, including conditioning, scaling and regeneration/asymptotic stationarity of the 
driving sequence {£n}. 

2 Conditioning on the future 

We assume that the underlying process {£ n }nez (defined on some underlying probability 
space (O, F, P)) consists of i.i.d. random variables £ n . For two events A and B, we write 
A = B if their symmetric difference, AoB = A\ BL)B\A, has probability zero. 

For m < n denote by a m ,n the cr-algebra generated by £ m , . . . ,£ n , and let a n = <7_oo in . 
The process {X n } n€ z (or {A n } ne z + ) of interest will typically be defined in terms of the 
process {S, n }nez and adapted with respect to the filtration {<r n } ng ^; for example it may 
be defined by the stochastic recursion 



for some function / (and hence homogeneous Markov) 

Define also a to be the sigma-algebra generated by all the random variables £ n , — oo < 
n < oo. As usual, we may introduce a measure-preserving shift transformation 9 on o- 
measurable random variables by assuming that £ n o 9 = £ n +i, for all n, and that, more 
generally, g(^ m , ■ ■ ■ , Cn) ° & = d(Cm+i, ■ ■ ■ , £n+i) 5 for any measurable function g. (Here the 
finite sequence of random variables {£, m , . . . , £ n } may also be replaced a half-infinite or an 
infinite one.) 

We may further extend the shift transformation to events in a by defining (with a slight 
abuse of notation) G\ o 9 = G2 if 9 = Iq 2 . (Here by Iq 1 we denote the indicator 
function of the event G\ which equals 1 if the event G\ occurs and otherwise). We 
then say that a sequence of events {G n } is stationary if it is so with respect to 9, i.e. 
G n o 9 = G n+ i, for all n. Therefore, if there are two sequences and each of them is 
stationary, then also they are jointly stationary. 

In what follows, we consider, in addition to the process {£ n } 5 a given sequence of events 
{F n } n £z + which always satisfies the following conditions: 

(Fl) The sequence {-F 1 n }nez + is stationary, with the common value ofP(F n ) strictly pos- 



(F2) For each n, the event F n is defined in terms of the "future" process {£m}m>n, i.e. 
If u = <7(£ n+ i,£ n+ 2> • • • ) for some function g (which by stationarity is independent of 




(1) 



itive. 
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n). Here the future dependence of each of the events F n may be on either the finite 
or the infinite future. 

It is our intention to define, in terms of the process {£ n } and the sequence {F n }, a sequence 
of random times < To < t\ < . . . on the nonnegative integers Z + . Our interest is in 
the behaviour of the successive segments of processes {£ Tfe+ i, . . . , £ rfe+1 }, k > 0. (Note 
that the definition of any such segment {£ Tk+ i, . . . , £ Tk+1 } includes a specification of its 
length Tfc+i —T~k-) It is convenient to take a "point process" approach, and to define first 
a further sequence of events {A n } ne z+', the times To are then defined to be the successive 
times n > such that the event A n occurs. (We observe that the need to unambiguously 
index the times r k obliges us to choose some origin of time, and it is then convenient 
to restrict attention to behaviour subsequent to time 0. However, to the extent that the 
times of occurrence of the events A n may be viewed as a point process on the positive 
integers, much of what follows may be extended without difficulty to the entire set Z of 
all the integers.) 

Remark 1. Insofar as the times of occurrence of the events A n may be regarded as a point 
process on the integers, the determination of their locations, in the results below, is the 
result of simultaneous, and essentially Markovian, conditioning from both the past and 
the future. There are therefore connections with the theory of one-dimensional Markov 
random fields. However, for our present purposes, it is natural to define the conditions 
for these results directly in terms of events. The distribution of the point process is then 
induced by the underlying i.i.d. driving sequence 

Our main result of this section is now the following theorem. For the result to hold, we 
require some conditions which imply, in particular, that each event A n may be represented 
as an intersection A n = H n n F n of a "past" event H n £ a n and the "future" event F n 
defined earlier (see Remark 2 below). 

Theorem 1. Let a sequence of events {A n } n€ z + be given. Let To = min{n > : Ia„ = 1} 
and, for k > 0, let T k +i = min{n > T k : = 1}. Assume that T k < oo a.s., for all k. 
Let also the following be given: a sequence of "future" events {-F n }neZ + satisfying the 
earlier conditions (Fl) and (F2), sequences {H' n } n ^j 1+ and {H^} n& z + of "past" events 
such that, for each n, we have H' n € a n and H" G a n , and, finally, an array of events 
{£ , nin+m } n >o,m>o with each E n)n+m G a n+ i^ n+m and such that, for each fixed m, the 
sequence {-E n ,n+m}n>o is stationary. Suppose further that all these sequences are linked 
by the following relations: for n > 0, 

{T = n} = A c n---riA c n _ 1 nA n = H' n nF n , (2) 

and, for < n' < n, 

{3 k : r k = n', r k+1 = n} = A n , n A c n , +1 n • • • D A c n _ x n A n = H'^ n £ n> n F n . (3) 

Then the successive segments of processes {£ Tfe +i, . . . , £, Tk+1 }, k > 0, are independent and 
identically distributed. In particular the random variables T k+ \ — r\~, k > 0, are i.i.d.. 
Further, for some constant a > 0, and for all k > 0, 

P(r fc+1 - Tk = n) = aP(E ,n). (4) 

Note that it follows directly from (2) and (3) that, for all n, we have A n C F n , and from 
(3) that, for all n', we have A n i C H",. Hence we note 

A n C HH n F n , n> 0. (5) 
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Proof of Theorem 1. Fix k > 0. For any < no < • • • < rik+ij it follows from (2), (3) and 
the observation that A n C F n for all n, that the following representation holds: 

{r = n , . . . , r fc = n k , r k+1 = n k+ i} 

= H n n H n n E n ,m H H^i C • • • fl i?" fc n E nk:rik+1 fl F nfc+1 (6) 

where the intersection of all but the last two events in (6), say -ff nfc , belongs to the sigma- 
algebra a nk and is the same for all values of n k+ \. Thus for any events G nk £ a nk , 

Gn k ,n k+1 £ Cn fc +l,n fc+1 ) 

P({t"o = «o,- • • ,Tk = n k , T k+ i = n k+ i} n G nk n G nfeinfc+1 ) 

= P (^nfc ^ E nk ,n k+1 H G nkt n k+1 fl ^rifc+i) 

= P ( G, n fe ) P (- E 'n fc ,n fc+1 D G„ fc irlfe+1 )P (F nfc+1 ) . (7) 

where the event = -ff nfe fl G nfe belongs to a nk and is the same for all values of n k+ \ 
and for all events G nk>nk+1 . Thus, using also the stationarity of the sequence {F n } n€ % + 
and (for each m) of the sequence {E n>n + m } n >o, it follows that, conditional on {tq = 
no, ... , r k = n k } and the process {£ n }i<n<n k , the distribution of {£r fe +i, • • • , ^r fc+1 } is that 
of {£ T0 _|_i, . . . ,Cn} conditional on the occurrence of the event {tq = n}, for any n such that 
the latter probability is strictly positive. All the assertions of the theorem now follow. 
In particular, to establish (4), we consider (7) again with G Uk = G nk ^ nk+1 = £1 and with 
n k+ \ = n k + n where n is fixed. Then we sum the expression (7) all < uq < ... < n k to 
obtain P(r k+ i — T k = n). This is of the form aP(£o,n) where, clearly, a does not depend on 
n; therefore a also does not depend on k since the probabilities aP(Eo jn ) sum to one. □ 

Remark 2. It is worth pausing to note, in somewhat intuitive terms, the significance of 
the conditions of Theorem 1. Note first that it follows straightforwardly from (2) and (3) 
that, for all n, we have 

A n = H n DF n , with H n = H' n yj \J fl£ n E nl>n G a n . (8) 

0<n'<n 

Suppose now that we proceed forwards in time with the process {£ n }- At each time n such 
that the event A n occurs, we learn something about the future evolution of the process, 
namely that the event F n occurs. In order to have some regeneration at this time, we 
need to ensure that, at each such time n, the knowledge that F n occurs is the sum total of 
our knowledge about the future at this time, and includes everything which we may have 
learnt about the future at earlier times n' < n (whether, for each such time, that is the 
occurrence or the non-occurrence of the event A n > ) . This is essentially guaranteed by the 
condition (3), which is in effect a form of monotonicity condition. 

We now give some special cases of Theorem 1. Corollary 2 will be applied later to the 
two-state contact process of Section 3.1 and to the basic infinite-bin model of Section 4.1. 

Corollary 2. Suppose that, for all n, we have A n = F n and that the sequence {F n } n i=z + 
satisfies the earlier conditions (Fl) and (F2) and additionally the monotonicity condition 

E 'n,n+m n F n+m , n > 0, m > 0, (9) 

for some array of events {E' n n+m }n>o,m>o with each E' n n+m G a n+ i^ n+rn and such that, for 
each fixed m, the sequence {E' n n+m } n >o is stationary. Then the conclusions of Theorem 1 
follow (with (4) holding for appropriately defined Eq u ). 
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Proof. Note first that (9) implies that also 

F n c n F n+m = (E' n>n+m ) c n F n+m , n > 0, m > 0, (10) 
Since A n = F n for all n, it follows from (9) and (10) that, for all n > 0, 

A c n • • • n n A„ = (^J c n • • • n (K-i,J c n F n 

and, for < n' < n, 

A n , n A c n , +1 n • • • n n A n = E' n , <n n «, +1 ,J c n • • • n (K-i,J c n F„. 

Thus the conditions of Theorem 1 are readily seen to be satisfied with {-F n }nez+ as 
here, and for appropriately defined {H' n } ne z+, {H'n}nez+ (with H" = Q for all n) and 

{-£'n,n+m}n>0,m>0- d 

Remark 3. We can now provide some explanation for the observations of Example 1 in 
the Introduction. In the variant (a), the condition (9) of Corollary 2 is readily seen to be 
satisfied, with E' n n+m = {Y^ILi £,n+i > for all 1 < m' < m}. In the variant (b) of Exam- 
ple 1 the monotonicity condition (9) of Corollary 2 (with the sequence {F n } n >o replaced 
by {i 7 ^}n>o) clearly cannot be satisfied, and more generally the conditions of Theorem 1 
cannot be satisfied (for otherwise that theorem would contradict the known behaviour for 
this example). However, for the variant (c) of Example 1 we may observe that the condi- 
tion (9) of Corollary 2 (again with the sequence {F n } n >Q replaced by {Fn} n >o) is satisfied 
whenever m > 2, with E' n n+m = {^2=i Cn+i > for all 1 < m! < m and £ n +2 = 0}. Since 
the enforced minimum separation — r^-i > 2 for k > 1 implies that A n n A n+ i = for 
all n, this restricted version of the condition (9), coupled with the proof of Corollary 2, is 
now sufficient to establish that the conditions of Theorem 1 are satisfied as before. 

We now give a generalisation of Corollary 2 in which the sequence {A n } n ^z + is defined 
by A n = H n n F n for the sequence {F n } n ^z + as above and with {H n } n ^z + some sequence 
such that each H n £ a n . Here additionally a monotonicity condition is required on the 
sequence {H n } n£ z + . However the monotonicity condition on the sequence {F n } n£ z + is 
only required to hold in relation to those times n at which the event H n occurs. The 
result, which reduces to Corollary 2 in the case where H n = £1 for all n, is entirely natural 
for many applications. It will be applied in Example 2 below, to the three-state contact 
process of Section 3.2, and to the continuous-space "infinite-bin" model of Section 4.2. 

Corollary 3. Suppose that, for all n, we have A n = H n nF n , where the sequence {F n } n€ % + 
satisfies the earlier conditions (Fl) and (F2) and the sequence {H n } n ^z + is such that 
H n G a n for all n. Suppose further that these sequences satisfy the following monotonicity 
conditions. 

(a) For all n > 0, m > 0, 

A n n A n j rm = H n n E n n ^_ m n A n + m , (n) 

where the array of events {E' n n+m } n >o,m>o is such that each E' n n+m £ a n+ i jn+m and, 
for each fixed m, the sequence {E' n n+m } n >o is stationary. 

(b) For all n > 0, m > 0, 

A n n H n + m = A n n E n ^ n ^_ m , (12) 

where the array of events {-E , " in+m }n>o,m>o is again such that each E'^ n+m G a n+ i tn+m 
and, for each fixed m, the sequence {E 1 ^ n+m } n >o is stationary. 
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Then the conclusions of Theorem 1 follow ( again with (4) holding for appropriately defined 
Eo,n)- 

Proof. The proof is similar to that of Corollary 2, if a little messier. It is necessary to 
verify the conditions (2) and (3) of Theorem 1, in which the sequence {F n } n ^z + of that 
theorem is as given here. Note first that (11) implies that also, for all n > 0, m > 0, 

H n nF„ c n A n+m = H n n {E n ^ n+m ) c n A n+m , (13) 

while (12) similarly implies that also, for all n > 0, m > 0, 

A n n H c n+m = A n n « n+ J c . (14) 

Consider first the verification of the condition (3). For < n' < n, the event 

A n , n A c n , +1 n • • • n A c n _ x n A n (15) 

may be written as a union of events of the form 

4/n%in-nB n -inA, (16) 

where, for each n' < k < n, the event is either H%. or HkCiF^. Now using equation (14) 
to simplify A n i n H^., equations (13) and then (14) to simplify Hf. flF fc c n A n , and finally 
equation (11) to simplify A n i n A n , it follows that each of the events given by (16), and 
so also the event given by (15), has a representation as H n i n E n ^ n n F n , where, by 
construction, the array {-E n ' n}n'>o n>n' satisfies the conditions of Theorem 1. 
The verification of the condition (2) of Theorem 1 (for some readily calculable sequence 
{H l n }n£Z + with each H' n € a n ) is similar, but simpler. □ 

We now consider a process {X n } n >o which, as indicated at the beginning of this section, 
is adapted with respect to the filtration {o- n }n<=z (or {cr„} ne z + ). We further assume that 
this process is defined via the specification of Xq and the stochastic recursion (1). This 
is a standard situation (but not the only one) in which the regenerative structure of the 
successive blocks of the process {£ n }> as identified in Theorem 1, may be inherited by a 
(functional of the) process We introduce here a number of typical scenarios which 

will be complemented by the examples of the following sections. 

In what follows we wish to consider, for any time re, the dynamics of the sequence 
{X n+ i}i>o, and of functionals of this sequence, relative to "an initial" X n . (One may 
think of a growth model in which we are adding points at each time, or of a model in 
which we center the system around the value of X n at time n.) In order to do this we in- 
troduce functions Ri(X n , X n+ i), i > 1, which capture this relative behaviour. We assume 
further that each such function Ri acts as Ri : X 2 — > y where (X,Bx) is the space in 
which X n take values and (y, By) is another measurable space. In various of the remaining 
examples of this paper, we indicate precisely the form of the functions Ri. 
Recall that a sequence, say {1^}, is stationary one-dependent if it is stationary and, for 
any n, the families of random variables {Yjj, k < n} and {Y^, k > n} are independent. 
The following result is a immediate extension of Theorem 1 and the given conditions (17), 
(18), (20). 

Theorem 4. Suppose again that the the sequence {£ n }nez consists of i.i.d. random vari- 
ables and that the random times < tq < r\ < . . . are defined as in Theorem 1, with all 
the conditions of that theorem holding. 
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(a) Suppose that the functions Ri, i > 1, introduced above are such that, for any n, given 
that the event A n occurs, each random variable Ri(X n+ i, X n ) is a measurable function 
o/£ re +i, • • • ,in+i only, i.e. for every i > 1, 

Ri{X n+ i,X n )lA n = gi{in+l, ■ ■ ■ ,£,n+i)lA n - (17) 

Then the random elements 

(Ri(X Tj+i ,X Tj ), i = l,..., Tj+i - Tj) (18) 

are i. i. d. in j . 

(b) Suppose, more generally, that, for some fixed m > 1, the functions Ri, i > 1, in- 
troduced above are now as follows: for any n, given that the event A n occurs, each 
random variable Ri(X n+ i,X n ) is a measurable function of £ n - m +i, ■ ■ ■ ,Cn+i only, i.e. 
for every i > 1, 

Ri(X n+ i, X n )lA n = gi(£n-m+l, • • • j £,n+i)lA n (19) 

and that 

T n+ i — r n > m a.s. for all n. (20) 
Then the random elements (18) are stationary one- dependent. 

Recall that a random sequence {Z n } is regenerative if there exist (random) times < to < 
T\ < . . . such that the random elements 

Yq '■= i T o', Zq, ... ,Z to ), Y\ := (ri — To; Z T0+ i, . . . , Z T1 ), Y 2 := (t2 — T\\ Z T1+ i, . . . , Z T2 ), . . . 

are mutually independent and the elements {lfc}fc>i are identically distributed. The ran- 
dom sequence {Z n } is wide-sense regenerative if {lfc}fc>o are one-dependent and {lfc}fc>i 
are identically distributed. 

Corollary 5. Suppose that the the sequence {£ n } n ez consists of i.i.d. random variables 
and that the random times < tq < t\ < . . . are defined as in Theorem 1, with all the 
conditions of that theorem holding. Suppose that the functions Ri, i > 1, introduced above 
are such that either the conditions of part (a) or those of part (b) of Theorem 4 hold. 
Finally suppose that the (cottittiotiJ distribution of the rcLTidoTn vdvidbles t u — T n —\^fi 

> i, 

is aperiodic, i.e. GCD{j : P(ti — To = j) > 0} = 1. 
For any n > tq, let 

Z n = R n _ Tj (X n ,X Tj ) if tj <n< Tj+i. (21) 

Then sequence Z n converges in the total variation norm to a proper limiting random 
variable. 

Indeed, by Theorem 4, the sequence Z n is wide-sense regenerative, so Corollary 5 follows 
from the stability theorem for wide-sense regenerative processes, see e.g. Section 10 in [27], 
or [1]. 

Example 2. Random walk with positive drift. We extend Example 1 to consider a general 
random walk with positive drift. Such a process provides possibly the simplest instance 
of the application of the above theory, and our aims here are both to demonstrate the use 
of Theorem 1 and to illustrate the use of conditioning simultaneously on both past and 
future events. The results we give for this example are not new, but rather illustrate the 
immediate applicability of the present theory. The sequence {£ n }n>i consists as usual of 
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i.i.d. non-degenerate random variables £ n with positive mean a = E£ > 0. To make the 
example nontrivial, assume P(£ < 0) > 0. The process of interest is the random walk 
{S n }n>o with So = and S n = Y17=i & ( we nere use the notation S n instead of X n ). 
We define the earlier sequence {F n } n& z + , satisfying the conditions (Fl) and (F2), by 
taking each F n to be the event that Y^=i^n+k > for all m > 1, i.e. that S m > S n for 
all m > n. 

First, for a trivial application, we define the events A n of Theorem 1 by, for each n, 
A n = F n , so that the random times k > 0, are simply the successive times of occurrence 
of the events F n , and are simply the last exit times of the process {S n } above successive 
levels k. As in the variant (a) of the earlier Example 1, the condition (9) of Corollary 2 
is easily seen to be satisfied (with E' nn+m = {Y^k=i Cn+k > for all 1 < m! < to}). Thus 
the conclusions of Theorem 1 follow, and we have the well-known and elementary result 
that the segments of the process {S n } between the successive last exit times above are 
independent and identically distributed. 

We observe also that the functionals Ri defined above are typically given by Ri(S n+ i, S n ) = 

Sn+i S n . 

A more interesting application is given by defining the events A n of Theorem 1 by, for 
each n, A n = H n n F n , where H n is the event that S n ' < S n for all < n' < n. Thus the 
times Tfc are the successive times n at which both S n > < S n for all n' < n and S n > > S n for 
all n' > n. The sequences of events {F n } n£ z+ and {H n } n< =z + satisfy the conditions (11) 
and (12) of Corollary 3, with E' nn+m as above and E'l in+m = {S n > < S n+m text for 
all n < n' < n + to}. Hence again the conclusions of Theorem 1 follow, and we again 
have the result that the segments of the process {S n } between the successive times are 
independent identically distributed. A weak consequence is that these times themselves 
form a delayed renewal process. 

Here again the functionals Ri of Section 2 are typically given by ^^(^n+i? — $n-\-i S n . 

3 The asymptotic behaviour of supercritical contact pro- 
cesses. 

The theory of Section 2 has applications to a variety of particle systems and oriented 
percolation models. In this section we consider some fairly general discrete-time contact, 
or oriented percolation, processes on the integers Z. These models are normally studied 
in a continuous-time setting, and it is clear that the relevant theory of Section 2 could, at 
the cost of some work, be adapted to that setting. 

In Section 3.1 we study a modest generalisation of the traditional two-state contact process 
on Z, in which, at each time n, each site a G Z is either healthy (state 0) or infected 
(state 1). We use our earlier theory to study the behaviour of the right- endpoint process, 
defined for each time n to be the rightmost infected site at time n. The underlying ideas 
here are those of Kuczek [19] and of Mountford and Sweet [23] — the somewhat greater 
generality of the model considered here makes little difference. However, we show that 
the results of Kuczek are an almost immediate application of the theory of Section 2, 
and become clearer when thus understood. (These ideas are further used by Mountford 
and Sweet, but the main work of their paper is an additional "block" construction to 
show that a certain event has a strictly positive probability — see the discussion at the 
end of this section.) This basic theory of Section 3.1 is further a necessary preliminary 
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for applications to other particle system models. We give one such in Section 3.2 in 
which we study an extension to a three-state process. In this model, which has been 
considered by a number of authors, healthy sites differ in their susceptibility to subsequent 
infection according to whether they have previously been infected. Tzioufas [28] deduces 
right-endpoint behaviour for the "reverse-immunisation" version of the process, in which 
previously infected sites are easier to reinfect. His argument uses a monotonicity property 
which fails to hold in the "immunisation" version of the process, in which previously 
infected sites are more difficult to reinfect. We show how this difficulty is overcome by a 
suitable definition of the sets F n of Section 2. 

3.1 The two-state contact processes 

Consider a process in which sites, indexed by the integers Z, are at each time n either 
healthy or infected. We define the state X n of the process at time n to be the set of 
infected sites at that time. Between times n and n + 1 each site x £ X n which is infected 
at time n produces a set rj n +i tX C Z of descendants, which is again a subset of Z; at time 
n+1 these descendants infect a set of sites x + %+i x Q Z, where for any x £ Z and any 
A C Z, we define x + A = {x + a:a£ A}. The state X n+ \ of the process at time n + 1 is 
given by 

^n+l = |J (x + T] n+ltX ), (22) 

xex„ 

i.e. is the union over x £ X n of the sites infected by the descendants of these x. Finally 
we assume that the random sets T] n +\ yX are independent and identically distributed over 
both times n and sites x. This model is a fairly general form of the discrete-time version 
of the one- dimensional contact process, or oriented percolation. Note that we do not make 
the restriction (common for both discrete-time oriented percolation and continuous-time 
contact processes) that, for each n and x, the random set Tfo+i^ is such that the events 
{a £ T] n+ i^ x } are independent over a. 

Let p be the probability that the process started with Xq = {0}, say, survives, i.e. X n ^ 
for all n > 0. Suppose that p > 0, so that the process is described as supercritical. Our 
interest is then in the long-run behaviour of this process. In particular we are concerned 
with the behaviour of the right-endpoint process {7" n } n >o, conditional on survival, where 
we define r n = max(x : x £ X n ) (with r n = — oo in the case where X n is empty). This, 
coupled with the behaviour of the corresponding left-endpoint process, determines the 
growth rate of the process. We assume that Xq is such that ro < oo (and hence r n < oo 
for all n); usually ro = 0. 

Consider first the case in which the process possesses the following skip-free property: for 
all n and all x, y £ Z, 

x < y => x + a < y + b for all a £ r] n+ i tX , b £ r] n+ i ty a.s. (23) 

This is the discrete-time version of the nearest-neighbour property of the contact process 
on Z. The process {r n } n >o is here studied by Galves and Presutti [16] and by Kuczek [19]. 
The argument here is essentially a rephrasing, in the framework of the present paper, of 
that of Kuczek, and is given not only as an example and for completeness, but because 
it is required for subsequent developments, in particular for the theory of Section 3.2, in 
which the present arguments are extended and generalised. 
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We take the driving sequence {£ n }n>i (the index range n > 1 is sufficient), introduced in 
Section 2, to be defined as follows. For each n, £ n = {£,n,z}z<0i where for each nonpositive 
intee er z } ^ri,^ has the same distribution as any of the random sets f] n x identified above. In 
addition to being identically distributed, the random sets £ rej2 are taken to be independent 
over all n and all z. We now define the process {X n } n >o via a stochastic recursion 

X n+1 = /(X n ,£n+l); (24) 

for each x G X n the random set r] n+ i tX of its descendants at time n + 1 is given by 

7 ]ri+l,x = £,n+l,x—r n - (25) 

Thus in particular — and this is critical for the understanding of the argument below, in 
which everything is in effect viewed from the right endpoints of the processes of interest — 
the random set £ n +i,o determines the set of descendants of the rightmost infected site r n 
at time n, and for every other infected site at time n we count its distance from r n in order 
to determine which of the random sets £ n +l z to use for its set of descendants. Different 
initial sets Xq of infected sites lead to different instances of the process {X n } n >Q. 

For each n > 0, consider the process {xffi } n '>n defined by Xn = {0} and X^ +1 = 
f(X^/,^ n ' + i) for n! > n. Define also the associated right-endpoint process {r^} n >> n by 
r\? = max(x : x G X^ ') (again with r^, = — oo in the case where X^' is empty). 
We define the sequence of events {i ? n }nez+ of Section 2 saying that the event F n occurs 
if and only if the process {xffi} n i> n survives for all future time. It follows from the 
definition of the process {xffi } n '>n that the sequence {F n } ne % + satisfies the conditions 
(Fl) and (F2) of Section 2. In particular, the common value of the probability of the 
events F n is p, which, by our earlier assumption of supercriticality is strictly positive. 

We define the events A n of Theorem 1 by, for each n, A n = F n , so that the random times 
Tfc, k > 0, are simply the successive times of occurrence of the events F n . It is our intention 
to apply Corollary 2. Fix therefore n > and m > and suppose that the event F m+n 
occurs. Then if also the process {X^ } n '> n survives to time n + m, i.e. X^ m / 0, it 
follows from (24) and (25) that 



r { :l m+n > = r^ m + r^l, for all nf > 0. (26) 

We now have that, given that the event F m+n occurs, the event F n occurs if and only 
if there occurs the event E' nn+m that the process {X^ } n '> n survives to time n + m. 
We thus have that the monotonicity condition (9) of Corollary 2 is satisfied (with F n , 
F n+m and E' n n+m as defined here) and that, by construction, the array {E' n n+m } n >o,m>o 
satisfies the conditions of that corollary, so that the conclusions of Theorem 1 follow. Since 
also the events F n have strictly positive probability p, and since their indicator random 
variables Ip n form a stationary ergodic sequence, the first statement of Proposition 6 below 
is now immediate from Theorem 1 combined with the strong law of large numbers for such 
sequences. 

The proof of the second statement of Proposition 6 is also essentially due to Kuczek, but, as 
we require essentially the same argument (with a little extra complication) in Section 3.2 
below, we summarise it here. Define the random time r' = {minn > 1 : F n occurs}. 
The common distribution of the intervals t^+i — 7fc, k > 0, is that of the random time 
T\ conditioned on the event {tq = 0}, i.e. on the event Fq, which has strictly positive 
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probability. The latter distribution is also that of the random time r' conditioned on the 
event Fq. Hence, for the second statement of Proposition 6, it is sufficient to show that 
the (unconditional) distribution of r' is geometrically bounded. We show that this follows 
from the well-known property of supercritical contact processes that if p = min{n > 1 : 
X n °^ = 0} then there exists a > such that 

P(n < p < oo) < e~ an , n > 1. (27) 

To see that r' is geometrically bounded, we may proceed forward in time, starting at time 
1, checking at that and at selected subsequent times n whether the event F n occurs: if, at 
any such time, it fails to do so we wait until the process {X^) } n >> n dies before resuming 
checking at subsequent times, thereby ensuring that checks are independently successful, 
each with probability p > 0; the time to the occurrence of a first success, and hence to 
the occurrence of some event F n , is thus a geometric sum of i.i.d. geometrically bounded 
random variables, and is hence itself geometrically bounded, implying the same result for 
t' . We thus have the following proposition. 

Proposition 6. The successive (segments of) processes {£ Tfe +i, . . . , £, Tk+1 }, k > 0, are 
independent and identically distributed, each with finite mean length 1/p. Further the dis- 
tribution of each of these lengths is light-tailed, i.e. geometrically bounded, and in particular 
possesses moments of all orders. 

Now let {X n } n >Q be any version of the contact process defined by (24) such that Xq ^ 
and, if {r n } n >o is its right-endpoint process, then ro < oo. Let F be the event that the 
process {X n } n >Q survives. Then, as in the argument above used to establish (9), the event 
F occurs if and only if the process survives to time ro- Note also that Fq C F; in the 
extreme case where there is a single infected site at time we have Fq = F, while in the 
case the number of infected sites at time is infinite, we have P(-F) = 1. Further, from 
the construction of the processes involved and recalling (26), conditional on the event F 
and for all k > 0, 

fe-i 

r Tk+n , =r T0 + Y J + for all n> > 0. (28) 

j=0 

We thus have immediately the following corollary to Proposition 6. 

Corollary 7 (Kuczek). On the set F the successive (segments of) processes {r Tk+ \, . . . , r Tk+1 }, 
k > 0, are independent and identically distributed. Further, for some constant p, 



n 

and, in the Skorohod topology, 
r[nt] - n ^ 



— — > p a.s., as n — > oo (29) 



n 



B(t) in distribution, as n — > oo, (30) 



where, for any a > 0, we denote by [a] the integer part of a, and where B is Brownian 
motion with some nontrivial diffusion constant. 

Remark 4. We believe that it is worth also discussing briefly the more general case, con- 
sidered by Mountford and Sweet [23], in which the skip-free condition (23) is replaced 
by the more general condition that the sets r] n +i x have bounded support, if only as an 
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illustration of our general thesis that everything depends of the appropriate definition of 
the sequence {F n } n£ z + of Section 2. Here it is sufficient to redefine the events F n and 
to show that their common probability remains strictly positive. Thus, for each n, define 
not only the process {xffl } n '>n as above (in which = {0}) and its associated right- 
endpoint process {r^} n >> n , but also the process {X^ } n '>n given by X ™ = (where 
Z_ is the set of nonpositive integers) and xffl +1 = f(X^\^ n+ i) for n' > n; denote also 
the latter process's associated right-endpoint process by {rff} n '> n . Note that the process 
{xfy } n '> n survives almost surely, and that, since X^ C X^\ we have xffi C xffi for 
all n' > n. The event F n is now defined to occur if and only if rty = rty for all n' > n. 
(The latter condition implies the survival of the process {X^} n i> n and is equivalent to 
it in the earlier skip-free case.) Further, the sequence {-F n }nez + continues to satisfy the 
conditions (Fl) and (F2) of Section 2, provided only that we can show that the common 
probability p' of the events F n is strictly positive. 

As before, we define the events A n of Theorem 1 by A n = F n for all n, so that the times 
Tfc are once more the times of successive occurrences of the events F n . It follows from the 
definition of the latter events that the condition (26) continues to hold for those n > 0, 
m > 0, such that event F n+m occurs. Thus the conditions of Corollary 2 hold as in the 
skip-free case, and indeed the entire argument of that case holds also in the present more 
general case, subject only to the above proviso that P(F n ) > 0. Thus, in this case, we 
once more obtain Proposition 6 (with p replaced by p') and Corollary 7 describing the 
behaviour of the right-endpoint process. 

That p' > is shown by Mountford and Sweet [23] — in the most difficult part of their 
paper — using a block construction and under a condition on the random sets rj n +i x which 
limits the extent of the dependence between the events {a £ a;}- While it seems likely 
that p' > in the present slightly more general model and that this should not be too 
difficult to show, we do not pursue this here. 

3.2 A three-state contact process with immunisation 

We consider a model in which the susceptibility of sites to infection depends on whether 
they have been previously infected. As noted above such models (in continuous time) have 
been considered by a number of authors (Durrett and Schinazi [11], Stacey [26], Tzioufas 
[28]). We show here how right-endpoint, and hence growth, behaviour can be deduced 
for a model with immunisation, in which previously infected sites are more difficult to 
infect than those which have not previously been infected. What is interesting here is that 
we do not have monotonicity of the process in the initial level of infection, in that the 
introduction of additional infected sites at time may possibly, by premature infection and 
then immunisation of neighbouring sites, reduce the number of infected sites at subsequent 
times (see Stacey [26] for details). This is in contrast to the two-state contact process and 
to the "reverse-immunisation" three-state process mentioned earlier. However, in the 
present model there do still exist sufficient monotonicity-preserving couplings, between 
instances of the process with suitably different initial states, as to enable progress to be 
made with a little extra care, notably in the definition below of the "future" events F n 
of Section 2 and below. A further complication is that the events A n of Section 2 are no 
longer simply defined by A n = F n , but rather the occurrence of the event A n depends 
both on the past and the future behaviour of the process {£ n '}n'>i relative to the time n. 
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We take our argument in stages: we consider first the model, then its formulation as a 
stochastic recursion suitable for the application of the theory of Section 2, and then the 
definition of the events F n and the times tj~ of Section 2; finally we apply the earlier theory 
and such additional arguments as are necessary to obtain our results. 

The model. The varying susceptibility of sites forces a more careful identification be- 
tween sites at one time period and another. We therefore focus on the following generali- 
sation of a simple oriented percolation model, which possesses the skip-free property (23) 
identified in the previous section and which is the discrete time analogue of the three-state 
nearest-neighbour contact process with a similar immunisation property. The model cor- 
responds to oriented percolation through time on the integers in which, given the state 
of the process at time n, each site which would potentially be infected at time n + 1 is 
only actually infected with some fixed probability q, independently of all else, unless it 
has never previously been infected, in which case it is infected with probability one. 
The state X n of the process {X n } n >o at time n is given by X n = {X n (x), x £ 1*} where 
each X n (x) G { — 1, 0, 1}, and where this has the interpretation: 

{ — 1 if the site x is uninfected for all n! < n, 
if the site x is uninfected at time n but has previously been infected, 
1 if the site x is infected at time n. 

In order to obtain a spatially symmetric model and to maintain the above skip-free prop- 
erty, we make the restriction that, at each time n, the set of sites x which possibly may 
be infected (X n (x) = 1) is the set of integers x G Z such that n + x is even. This will 
follow from the specification of the dynamics of the process below provided we require 
that only evenly numbered sites may be infected at time 0. (In these dynamics, which we 
make precise below, a site which is infected at time n reverts to state at time n + 1; a 
site which is in state —1 or at time n remains in the same state at time n + 1 unless it 
becomes infected at time n + 1, in which case its state becomes 1.) The above restriction 
on the locations of the infected sites at any time is of a purely technical nature and is not 
necessary is the (more natural) continuous-time version of the process. 

Thus we assume that X$ is such that Xq(x) ^ 1 for x odd. The state X n+ \ of the 
process is obtained from X n as follows: for each n and for each x G 7L such that n + x 
is even, associate a random set rj n+ i tX C {—1, 1}; the random sets r] n+ i tX are assumed 
independent and identically distributed over all n and all x. Define also, for each n, the 
set of "potentially infected" sites Y n+ i at time n + 1, given by 

Y n +i = [J (x + rj n+ljX ). 

x: n+x even, X n (x)=l 

Then, for x G Y n+ i such that X n (x) = 0, we take X n+ i(x) = 1 with probability q 
and X n+ i(x) = with probability 1 — q, independently of all else; for x G Y n+ \ such that 
X n (x) = —1, we take X n+ \(x) = 1 with probability 1. For x ^ Y n+ \ we take X n+ i(x) = — 1 
if X n (x) = — 1 and X n+ \(x) = otherwise. (Note that, by induction, these dynamics do 
indeed imply the property that, for all n and for all x, we may only have X n (x) = 1 
when n + x is even. Note also that there is no additional generality in allowing the above 
probability 1, that a never previously infected site in the set Y n+ \ becomes infected, to be 
replaced by any other probability q' > q: we may instead simply redefine the distribution 
of the random sets rj n+ i^ x .) 
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We shall say that the process {X n } n >o survives to time n if X n (x) = 1 for at least one x 
and that it survives if it survives to all times n > 0. We assume that the process {X n } n >o 
is supercritical, i.e. that, for any Xq such that Xq(x) = 1 for at least one x, there is a 
strictly positive probability that the process survives. Note that, if Xq is obtained from Xo 
by defining X' (x) = max(0, Xo(x)) for all x, and the resulting process {X' n } n >o allowed 
to evolve as above, then, in this coupling, the survival of the process {X' n } n >o implies 
that of the process {X n } n >Q. The former process may be viewed as an instance of the 
basic two-state contact process. It follows in particular the supercriticality of the present 
three-state process is equivalent to that of the two-state process obtained as above. 

Given the process {X n } n >o, for each re, define r n = max{x : X n (x) = 1} to be the right 
endpoint of X n (with, as usual, r n = — oo when X n (x) ^ 1 for all x). Our interest in the 
behaviour of the process {r n } n >o, for suitably chosen initial states Xq. (As usual, this, 
taken together with the corresponding behaviour of the left endpoint process, characterises 
the growth of the process {X n }.) 



Formulation as a stochastic recursion and coupling. We now reformulate the 
process {X n } n >o as a stochastic recursion (1) as in Section 2. The i.i.d. driving se- 
quence {£ n }n>i is given, for each n > 0, by the pair £ n+i = Here £' n+1 = 
z}z<q,z even and each C'n+i z — { — 1) 1} i s a random set with the common distribution 
of the random sets rj n+ i jX above. Further I n +\ = {I n +i,z}z<o, z even and each I n +i,z is an 
indicator random variable which takes the value 1 with probability q and is otherwise 0. 
For each re the random elements C'n+i and are independent; further the random sets 
£ri+i z are independent over all z, as also are the random variables I n +i, z - The process 
{X n } n >Q is now updated as described above, via the stochastic recursion (1), taking, for 
each n and x, 

Vn+l,x (31) 

analogously to (25). Further, given n, let r' n+1 be the rightmost point of the set Y n+ \ 
defined above; in the case where x' £ Y n+ \ is such that X n -\(x') = or X n ^i(x') = 1, we 
take 

X n +i(x') = I n+ x^ x i- r ' n+i , (32) 

while for x' G Y n+ \ such that X n _i(x') = —1 we already have X n+ i(x') = 1. 
For each n > 0, let {X^ } n '>n be any version of the process {X n i} n i> n , started at time n 
and defined through the above stochastic recursion (1) using (31) and (32) (with X { J ] 
replacing X n >), in which X„ (0) = 1 and X„ (x) = —1 for all x > 0. Let {c? } n '>n 
and {l^} n i> n be respectively the left and right endpoint processes associated with this 
process (i.e. r ™) = maxjx : xffi(x) = 1}, with fffi = — oo if no such x exists, and 
far = min{x : xffi (x) = 1}, with fff = oo if no such x exists). (Note that, for each 
n' > n, it is only possible to have X^\x) = 1 at those sites x such that n' — n + x is even. 
Since our various processes will eventually be coupled starting from their right endpoints, 
this is as it ought to be.) 

Define also the particular version {X^ } n '>n of the above process, in which 



1 if x = 0, 
if x < 0, 
-1 ifx>0, 
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Let also {r^ } n >> n and {1% }n'>n denote respectively the associated right- and left- 
endpoint processes. Note that it follows from the skip-free property of the dynamics 
of the process {xty } n '> n that, for all n' to which this process survives, 

X$ (x) ^ -1 for all x < r$ , (x) = for all x < 1$ . (33) 

We now require the following lemma, which is a simple generalisation of the classical 
result for the nearest-neighbour two-state contact process on Z, and which gives the basic 
coupling on which the application of the theory of Section 2 depends. 

Lemma 8. For any instance of the process {xffi} n >> n defined above and for the particular 
instance given by {xffi} n >> n , for each n' to which the latter process survives, 

X%> (x) = X%> (x) for all x > l% ] . (34) 

In particular we have fty = for all n' to which the process {^1? }n'>n survives. 

Proof. The proof is also a simple generalisation of that which is well-known for the classical 
two-state case, and is by induction on n' > n. Thus suppose that (34) holds for some 
particular n' > n such that the process {Xffi}n'>n survives to (at least) time n' + l. 
It then follows from the dynamics of the two processes involved, using also the above 
observations (33), that, for every x such that X^ +1 (x) = 1, we also have X^ +1 (x) = 1. 
Further, since the random sets r] n +i,x are subsets of {0, 1} (the skip-free property of the 
present model), any site x > l^ +1 such that X^ +1 {x) = 1 is necessarily infected (at 
least) by some site x' such that X^\x') = 1 so that also X^l^x) = 1 (i.e. no additional 
infection can pass from the left of at time n' to the right of l^t\_i at time n' + l). Since 
also X^ +1 (x) ^ -1 and X^ +1 (x) ^ -1 for all x < r%> +1 , and X^ +1 (x) = X^ +1 (x) = -1 
for all x > r^ +1 , we have that (34) holds with n' replaced by n' + 1. □ 

We shall also require below the particular instance {X n } n >o of the process 

n>0 

defined above (and started at time 0) given by 

if x < 0, 

X (x) = { ~ (35) 

if x > 0. 

This process is useful since, almost surely, it survives for all time. This enables us to make 
some necessary definitions without an a priori need to condition on survival. Define also 
{r n }n>o to be the right-endpoint process associated with the process {X n } n >Q. 



Definition of events F n and times r^. We define the sequence of events {F n } n ^z + 
of Section 2, analogously to Section 3.1, by saying that the event F n occurs if and only if 
the process {xffi} n '> n survives for all future time, i.e. rffl > — oo for all n' > n. It again 
follows from the definition of the process {Xv } n '>n that the sequence {F n } n£ z + satisfies 
the conditions (Fl) and (F2) of Section 2. (That the common value p, say, of P(i ? ) n is 
strictly positive follows once more from our earlier assumption of supercriticality.) 

For each n > 0, define the event 

H n = (X n {x) = -1 for all x > r n } (36) 



16 



(where {X n } n >o is the process defined above with initial state Xq given by (35)). Note 
that an equivalent definition is that H n = {r n > r n > for all n' < n}, i.e. that n is such that 
at that time the right-endpoint process {r n } n >o is at a record value. Note also that the 
event Hq always occurs, and further that, for all n, we have H n € a n . 

We define the sequence of events {^4 n }n>o of Theorem 1 by, for each n, A n = H n n F n . 
As usual the random times are the successive times of occurrence of the events A n . 
(The more complex definition of the events A n , in comparison with that of Section 3.1, is 
required to make the right-endpoint couplings below work correctly.) 
We can now state and prove the following analogue of Proposition 6. 

Theorem 9. The successive (segments of) processes {£ Tfc+ i, . . . , £ Tfe+1 }, k > 0, are in- 
dependent and identically distributed. Further the distribution of each of these lengths is 
light-tailed, i.e. geometrically bounded, and in particular possesses moments of all orders. 

Proof. We show first that the sequences of events {-F n } n >o and {-ff n }n>o defined above 
are such that the conditions of Corollary 2 are satisfied. Note first that it follows from 
Lemma 8 (applied at the time n) that, for any n such that the event H n occurs, 

T n ' =r n + r™, for all n > n to which the process {X^} n /> n survives. (37) 

We show first the condition (b) of Corollary 3. Fix n > and m > 0. Given that the 
event A n occurs (which implies both the occurrence of the event H n and the survival for 
all time of the process {X^ } n /> n ), it follows from (37) that the event H n+m occurs if and 
only if there occurs the event E'^ n+m that the process {r^? } n '>n is at a record value at 
time n + m, i.e. r^ji m > r^) m , for all < ml < m. The condition (b) of Corollary 3 is now 
immediate, since the array {E" n+m } n >o,m>o trivially possesses the properties required by 
that condition. For the condition (a) of Corollary 3, again fix n > and m > 0. Given 
that the event H n n A n+m occurs, it follows from (37) (both as stated and with n replaced 
by n + m) that the event A n occurs if and only if there occurs the event E' n n+m that the 
process {xffl} n i> n survives to time n + m. The condition (a) of Corollary 3 now follows, 
since again we have that the array {E' n n+m } n >o,m>o trivially possesses the properties 
required by that condition. Thus the first statement of the present theorem follows from 
Corollary 3. 

In order to prove the second statement, define the random time r' = {minn > 1 : 
A n occurs}. As in the corresponding argument for the second statement of Proposition 6, 
it is sufficient to show that the (unconditional) distribution of r' is geometrically bounded. 

We show first that, if p is the first time to which the process {A^} n >o fails to survive, 
then, as for the basic two-state contact process, there exists a > such that 

P(n < p < oo) < e" Qn , n > 0. (38) 

For each n > define the process {X^} n >> n via the above stochastic recursion (1) and 
(31), (32), with the initial state X n n) given by X n n) (0) = 1 and X n n \x) = for all other 
x. Let p be the minimum value of n > such that the process {A^?} n /> n (started at 
time n) survives. Suppose now that the process {A^} n />o survives to time p; then, in yet 
another instance of the coupling arguments used above (in which processes are "matched" 
from their right endpoints), it follows from the above stochastic recursion that the process 



17 



{X^, } n '>o necessarily survives for all time. We deduce that if p < oo then necessarily 
p < p, and thus we conclude that, for all n > 0, 

P(n < p < oo) < P(p > n). (39) 

However, given the driving sequence {£ n }n>ij the successive processes {xffi} n r> n are 
simply successive instances of the basic two-state nearest-neighbour contact process, in 
each case started with a single infective, launched by the sequence {£n}n>i exactly as in 
Section 3.1. We have already observed in that section that the time required to initiate 
such a process which survives (the time to the first of the events F n of that section) is 
geometrically bounded. The required conclusion (38) now follows from this and (39). 

To complete the proof, we need to show that the distribution of r' is geometrically bounded. 
We argue as in Section 3.1, again with a little extra complication. We again proceed 
forward in time, starting at time v\ = \ and checking at that, and at selected subsequent 
times Vk, k > 1, such that the event H Vk occurs, whether the event F Uk also occurs; if it 
fails to do so we wait until the process {X^, k ^} n i> Uk dies out — which we have shown it then 
does in a time which is geometrically bounded — before resuming checking for F Uk+1 at the 
first subsequent time Vk+i such that H Uk+1 occurs. It follows, again from the right-endpoint 
coupling of Lemma 8 as in the first part of the present proof, that, for each such k > 1, 
the increment r Uk+1 — r Uk is equal to the maximum value attained by the right endpoint 
of the process {X^! } n >> Uk prior to its dying out, and so this increment is geometrically 
bounded. Further, from the construction, the successive increments r Uk+1 — r Uk are i.i.d.. 
Let K be the number of checks required to obtain a success (the event F„ K occurs). Then, 
since, each of the above checks is independently successful with probability p > 0, the 
random variable K is geometrically distributed, independently of the above increments in 
the right-endpoint process {r n }. Thus r UK —7\ is a geometric sum of i.i.d. geometrically 
bounded random variables, and so r VK is geometrically bounded. 

Now let {f n } n >o be the right-endpoint of the three-state process {X n } n >o in which Xq(0) = 
1 and Xq(x) = for i/0. Then, from the usual coupling f n < r n for all n, and so also 
f VK is geometrically bounded. However, {X n } n >o is simply an instance of the supercritical 
two-state contact process, in which the set of initially infected sites is Z_. It follows easily 
from the results of Kuczek for the regenerative behaviour of this process (as given in the 
previous section) that, since f VK is geometrically bounded, the random variable vk is itself 
geometrically bounded. Since vk is the time n to the occurrence of some event A n , the 
result that r' is geometrically bounded now follows. □ 

Finally, consider again any instance {X n } n >o of our three-state process, defined by the 
stochastic recursion (1) via using (31) and (32) as above, in which the initial state Xq is 
such that Xq(xq) = 1 for some xq and Xq{x) = —1 for all x > xq. Again let f n i = max{x : 
X n i(x) = 1} be its associated right-endpoint process. Let F be the event that the process 
{X n } n >o survives. It follows from the earlier coupling for this process (with the time tq 
replacing the time 0) that event F occurs if and only if the process {X n } n >o survives to 
time To- Analogously to the situation for the two-state process, we have that Fq C F, and 
that, conditional on the event F and for all k > 0, 

k-i 

r Tk+n , = f T0 + + for all n' > 0. (40) 

3=0 

Thus, again as for the two-state process, we have the following corollary to Theorem 9. 
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Corollary 10. For the process {X n } n >o and on the set F defined above, the successive 
(segments of) processes {f Tfc +i, . . . , r Tk+1 }, k > 0, are independent and identically dis- 
tributed. Further, for some constant \x, 



> H a.s. 

n 



as n — >■ oo 



(41) 



and, in the Skorohod topology, 



r[nt] - nt V 
y/n 



B(t) in distribution, as n — > oo, 



(42) 



where again B is Brownian motion with some nontrivial diffusion constant. 

Similar behaviour holds for the left-endpoint process for any process {X n } n >Q whose initial 
state Xq is such that Xq(xq) = 1 for some xo and Xq(x) = — 1 for all x < xq. Thus, finally, 
for any process {X n } n >o whose initial state Xq is such that Xq(x) = — 1 for all x outside 
some finite interval, we may deduce the behaviour, conditional on its survival, of both its 
left and right endpoints. In particular, conditional on its survival, the growth rate of the 
process is given by 2//, where \i is as given by Corollary 10. 

4 Infinite-bin models 

In this Section, we consider a discrete-space infinite-bin model and its continuous-space 
analogue. 

In the discrete setting, we review the basic model introduced and studied in [12] (see also 
[10, 14]). We recall a stability result from [12] (see Proposition 11 below), with a new 
proof, and provide a new generalisation (see Theorem 12). We show that the both results 
may be considered as applications of the techniques developed in Section 2. 

Then we introduce a new continuous-space model and prove a new stability result there 
(see Theorem 14), by applying again the methodology from Section 2. 

4.1 Discrete-space infinite-bin model 
4.1.1 Basic model 

Consider an infinite number of bins arranged on the line and indexed, say, by the non- 
positive integers. Each bin can contain an unlimited number of particles (we assume 
it to be finite for the moment). A configuration is either a finite-dimensional vector 
x = (x_i, . . . ,xq) where Xi is the number of particles in bin i, or an infinite-dimensional 
vector x = (. . . , . . . , x$). 

The indexing by non-positive integers in convenient because we are interested in the asymp- 
totic behaviour of a finite number of right-most coordinates of vectors representing a 
stochastic recursion. At each integer step, precisely one particle — the active particle — of 
the current configuration is chosen according to some rule (to be given below) . If the par- 
ticle is in bin —i < —1, then a new particle is created and placed in bin — i + 1. Otherwise, 
if the chosen particle is in bin then a new bin is created to hold the "child particle" and 
a relabelling of the bins occurs: the existing bins are shifted by one place to the left (are 
are re-indexed) and the new bin is given the label 0. 
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To be more precise, define the configuration space X as the set of all infinite-dimensional 
vectors x = (. . . , X-2, x-\, Xq) with non-negative integer- valued coordinates, which have 
the following property: if x_i > 0, then X-i+% > 0. In other words, either all the coor- 
dinated of a configuration vector are strictly positive or there is only a finite number of 
non-zero coordinates, say I + 1 - then these are coordinates X-i, . . . , xq. We endow 

X with the natural topology of pointwise convergence, and let Bx be the corresponding 
class of Borel sets generated by this topology. 

The extent of an x E X is defined as \x\ = I, if there is I + 1 non-zero coordinates, 
x = (. . . , 0, 0, x_i, . . . , xq), with the C\ norm 

l 

IMI = x -ji 

3=0 

and if all the coordinates of x are positive, we set \x\ = \ \x\\ = +oo. 

Let N be the set of positive integers. The dynamics of the model may be defined using 
the map / : X X N — > X where 

f(x,g) = [x,l] if £ < Xq, 

k fc+1 

= x + e_fc if ^2 x -j < £ ^ < fc < |ac|, 

j=o j=o 
= x + e_\ x \, if £>||x||. 

Here [x, 1] is a concatenation of the vector x with 1, i.e. if x = (. . . . . . , xq), then 

[x, 1] = (. . . ,y-i-!,y-i, . . . ,y~i,yo) where y = 1 and = for j > 0. Further, 

e-j is the infinite unit vector whose (— j)th coordinate is 1 with all other coordinates equal 
to 0. Then, given an i.i.d. sequence {£ n }nez + of N-valued random variables and an X- 
valued random variable Xq, = (..., X_k,o, X^k+i,o, ■ ■ ■ , -X-i,o> ^o,o)> w e define a stochastic 
recursion by 

X n+1 = f(X n ,£ n+1 ), n>0 (43) 
where X n = (..., X_k^ n , . . . , -X"_i >n , Xo,n)- 

Verbally the dynamics may be explained as follows. Each time n we number again the 
existing particles from the rightmost bin to the leftmost (so, if X n takes value x = 
(. . . , 0, X-i, . . . , xq), then the particles in the rightmost bin are numbered 1 to Xq, in the 
next bin they are numbered xq + 1 to xo + and so on). Then the random variable £ n 
is the number of the active particle defined in the earlier description. 
Fix a non-negative integer k and let X n (—k) be the (A; + l)-dimensional projection of X n , 

X n (—k) = (X_fc >n , X_fc + i )n , . . . ,Xq jH ). 

The following result may be found in [12]. 

Proposition 11. Assume that {£ n }nez + is an i.i.d. sequence. Assume also that P(£j = 
1) > and E£j < oo. Then, for any integer k > 0, X n {—k) converges to a proper limiting 
random vector in the total variation norm. Therefore, X n weakly converges to its proper 
limit. 

Based on the theory from Section 2, one can provide a short alternative proof of Proposition 
11. We start with the simplest case k = 0. In this case, the proof is based on Corollaries 
2 and 5. 
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In order to avoid trivialities, assume P(£« = 1) < 1. 

Let the functions Ri of Section 2 be given by Ri{X n+ i, X n ) = Xo jn +i. Further, let 

F n = []{U +i <i} = f]F nA . (44) 

i>l i>l 

Note that, since E£, < oo, the events F n have strictly positive probability, and indeed 
satisfy the conditions (Fl) and (F2) of Section 2. Define now, for each n, the event 
A n = F n . Clearly 

m 

Fn n F n -\- m — C^l F n { H fn+nn 
i=l 

and so the condition (9) of Corollary 2 holds. Further, the condition (17) of Theorem 4 
holds because, given the event F n , the future process of placing particles is the same for 
all histories up to time n. 

Finally, the aperiodicity condition of Corollary 5 follows since 

P(r n+1 -T„ = l) = ^P(T n = Z,r m = Z + l) 

l 

= p ( r « = OP^+i I Fi) = P(Fi I F Q ) 

i 

oo oo 

= llP(Zi<i-l\Zi<i)>l[F(Zi<i-±)>0- 

i=2 i=2 

The proof of Proposition 11 now follows in the case k = from Corollaries 2 and 5. 

For the proof for general k > 0, we need events of the form B n = H n n F n where the events 
F n are again as given by (44) and 

H n = P| {£„,+!_.; = 1}. 
l<i<fc 

We may observe that, given H n , we have X n (—k) = (1, 1, . . . , 1). 
Now we define the events A n as follows: A n = 0, for n < 2k and, for n > 2k, 

k-l 

A n =f] B c n ^ n B n 

i=l 

which may be represented as A n = E n _k,n H F n , for a stationary sequence E n _k,n S 
a n -k+i, n - Finally, one may take Ri(X n+ i, X n ) = X n+ i(—k). Then all conditions of The- 
orem 4 are satisfied, and the result again follows from Corollary 5, on noting that once 
more aperiodicity follows from the condition P(£j = 1) > 0. 

Remark 5. This model has close links to the model from [9], see [12] for more detail. 
4.1.2 Extension of the basic model 

Consider the infinite bin model introduced in the Section 4.1.1 and let pi = P(£ = i). One 
of the main conditions in Proposition 11 is that p\ > 0. We assume now that this condition 
is violated and that instead the following condition holds: there exist two positive integers 
1 < i\ < %2 such that 

Pij > and pi 2 > 0. (45) 
Then the following statement holds. 
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Theorem 12. Assume that {£ n }nez+ is an i.i.d. sequence with a common finite mean 
E£j. Assume also that p\ = and that the condition (45) holds. Assume further that the 
numbers i\ and %i are mutually prime. Then, for any integer k > 0, X n (—k) converges 
to a proper limiting random vector in the total variation norm. Therefore, X n weakly 
converges to its proper limit. 

The proof of Theorem 12 will be based on the following simple observation (see, e.g., [8]). 

Lemma 13. For any two integers 1 < i\ < 12, there exist a positive integer m and a 
sequence of integers Ji,j2, • • • ,j m -i G {h,^} such that, for any n > m and for any vector 
X n _ m as in Section J^.l.l, we have 

X nfl lB n >hlB„ a.s. 
where the events B n are defined as 

m—l 

B n = {Zn = i 2 } n p| tin-m+l = jl} D {£ n -m = »2>- (46) 
1=1 

Proof of Theorem 12. By the conditions of the theorem, the stationary events B n defined 
by (46) have a positive probability. 

Let r = ji(k + 1). For n < r, we let A n = 0. For n > r, let A n = H n n F n , with 

H n = B n ^ r n D n where D n = Q {£ n +i-i =h}, 

l<l<r 

and where 

F n = f){tn+l<h + l-l}. (47) 

1>1 

Clearly, for n > r, given the occurrence of the event H n , all the coordinates of the vector 
X n (—k) are equal to i\. Thus, given the event A n , the placings of the particles numbered 
n + 1, n + 2, . . . do not depend on the left tail of the vector X n nor on the past values of 
the vector Xj, j < n. 

One can check directly that both the conditions (11) and (12) are satisfied. 

We may now define the functions Ri of Section 2 by Ri(X n+ i, X n ) = X n+ i(—k). Then the 
condition (17) holds which implies the conclusion (18) of part (a) of Theorem 4. 
Observe further that B n+ i n D n = 0, for any 1 < I < r. Therefore, A n n A n > = for all 
n < n' with n' — n < r + 12 — i\ and ~P(A n n A n >) > if n' — n > r + %i — i\. The latter 
implies the aperiodicity condition of Corollary 5, and the required result follows. □ 

4.2 Continuous-space model with varying link lengths 

In this section, we introduce and study a new model which is a continuous-space extension 
of the infinite-bin model, and which has applications in, for example, queueing theory. As 
described below, it may be viewed as a model for the locations of points on the negative 
real line, in which at each successive time precisely one of these points gives birth to a 
further point, and in which it is convenient to associate a link between this child point 
and its parent. We thus think of it as a random links model. Once again, our aim is to 
study the asymptotic behaviour of this model as "seen from the right" . 
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Before introducing the new model, we remark that the basic model of Section 4.1.1 may 
be described slightly differently. Namely, we may assume that, at each time n, particle 
number —j may be active with some probability, say p(—j). Each active particle proposes 
to put a new particle in the bin next to its own (in other words, at distance 1 to the 
right), and the rightmost active particle wins. If particles become active independently, 
then this description coincides with the description proposed earlier if we let P(£ > j) = 

uLa-p(-i))- 

Now assume, for simplicity, that all the p(—j) are equal and introduce the following 
continuous-space extension of the model, in which the positions of particles are real- valued: 
at time n, each active particle (say particle — j) proposes a location for the new particle at 
a random distance, l n ,-j to the right of particle — j (here the l n ,-j needs not be integer), 
and the rightmost proposed location (say that proposed by particle —jo) wins. Then we 
say there is a link of length l n ,-j from particle —jo to the new particle. 

Remark 6. One may view this model as a model of a system with infinitely many servers 
and with random constraints. There is an infinite queue in front; each successive client 
n is allocated to a free server, but the start of its service is delayed by the maximum of 
times ln-j of all previous clients that are active, see e.g. [12] and the references therein 
for further comments. 

Remark 7. One can consider various natural generalisations of this setting where the same 
methodology may be easily applied. For example, we may assume that, at any time, the 
first K > particles cannot be active and that all the others become active independently 
and either with equal probabilities p £ (0, 1] or with varying probabilities. 

Here is a formal description of the model. Let X be the space of left-infinite vectors of the 
form x = (. . . , x-k,X—k+i, ■ ■ ■ , X-i,Xq) where xq = and X-k < x-k+i, for all k > 1. We 
also assume that either all the coordinates of x are finite or some of them may be equal 
to — oo. In the latter case, due to the monotonicity, there will be only finite number of 
finite coordinates, say, X-j = -co for all j > k and x~j > -co for all j < k, for some 

k = 0, 1, Then we write for short x = (x-k, • • • , xq). We denote by Xq the space of 

finite-dimensional vectors (which may be viewed as a subspace of X). 

Let C be the space of infinite sequences 1 = (. . . , Z ^. _Z fe-f-i , • • • , lo) consisting of non- 
negative real-valued elements, and let Q the space of infinite sequences of the form q = 
(. . . , q- k , q-k+i, ■ ■ ■ , qo) where each q_ k G {0, 1}. 
Introduce the function 

/ : X x £ x Q -> Xq 
using the following rule. For x = . . . , xq), let 

h := /i(x, 1, q) = max (x_j + Z_j) 
i:q-i=l 

and 

h := h(x, 1, q) = x_ k 

if q-i = 0, for all < i < k. 

If h < and, say, x_j < h < x—j+i, for some j, then 

/(x,l,q) = {x-ki ...,x-j,h,x- j+1 ,...,Xo) 

and if h > 0, then 

h(x, 1, q) = (x_ fc - h, x- k+1 -h,...,x -h,Q). 
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In other words, if h < 0, we add an extra coordinate h, and if h > 0, we again add the 
coordinate and then subtract h from all coordinates of the new vector. 

Remark 8. An equivalent way to describe the dynamics is to use point processes. Instead 
of considering vectors, we may consider finite ordered sequences of points, with the right- 
most point at 0. 

Now we introduce stochastic assumptions. Let {l n } and {q n } be two i.i.d. sequences of 
vectors that do not depend on each other. Assume also that each l n and each q n consists 
of i.i.d. random variables, l n j and q n j. Let q = P(q n ,j = 0) = 1 — p with p = P(q n ,j = 1)- 
Assume that P(/o,o > 0) = 1 and that 

E (Z ,o) 2 < oo, (48) 

and let 

o = E/o,o- 

Recall that vectors X n always have infinitely many coordinates. Our model is now defined 
by starting from a fixed vector Xq £ Xq and running the a stochastic recursion 

A n +i = f(X n , ). (49) 

Our aim is now to establish the following analogue of Theorem 12 for the discrete-space 
model. 

Theorem 14. For any j > 0, the finite- dimensional projections (X n —j,...,X n o) of 
vectors X n converge to a proper limiting vector in the total variation norm. 

Proof. Let v n = min{i : q n -i = 1}. Then {fn} is an i.i.d. sequence with a common 
geometric distribution. It is convenient to us to assume this sequence to be doubly-infinite, 

— oo < n < oo. 

Analogously to Section 4.1.1, introduce the events 

FW=nK+i<j} 

and conclude that these events form a stationary ergodic sequence, each with a strictly 
positive probability 

p ( f o (i) ) =n(w)>°' 

and, moreover, satisfy the monotonicity condition (9). Thus, by Corollary 2, the times 
< T\ < T2 < . . . of occurrences of the events form a stationary renewal sequence. 
We may easily extend this sequence to stationary renewal sequence . . . < T_i < To < < 
T\ < T2 < . . . on the whole real line. 

Further, the i.i.d. cycle lengths tk = T^+i — k 7^ 0, have a light-tailed distribution (i.e. 
have a finite exponential moment) and, therefore, a finite positive mean b = Et\. Also, 
the cycle T\ — Tq has a light-tailed distribution. 

Assume for simplicity that the initial vector Xq corresponds to a single particle at the 
origin with all the others at —00. Number this particle 0. Each subsequent configuration 
X n adds precisely one further, finitely located, particle to the configuration X n _i (with 
the existing particles relocated if necessary). Number this particle n. Thus particles are 
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numbered in the order of their creation, and are assumed to keep their numbering for 
all subsequent times (including when they are relocated). Now colour "red" all particles 
numbered Ti, T2, . . ., i.e. those created at the times of occurrence of the events F^; colour 
"green" the remaining particles. For each n and for each k such that n > Tk+\, consider 
the relative locations of the particles in vector X n . The following observations are clear: 

• the red particle Tk is located to the left of the red particle Tk+i, and the distance 
between them is a random variable, say, dk which is stochastically bigger than the 
"typical" link Iq 0; in particular, Ec4 > a > 0; 

• all the green particles numbered Tk + 1, . . . , Tk+± — 1 are located between these two 
red particles; 

• the relative locations and, in particular, the distances between particles numbered 
Tfc, . . . ,Tfc + i stay the same, for all n > Tk+\. 

Therefore, if n = Tk+i for some k > 0, then the tk last coordinates of vector X n take values 
between — dk and 0, next (to the left) tk-i coordinates take values between —dk-i — dk 
and —dk, ■ ■ ., tk coordinates take values between — d\ — d2 — ■ ■ ■ — dk and — c?2 — ■ ■ ■ — dk, 
and then T\ coordinates are smaller than —dk — --- — d\ (recall that there are also infinitely 
many coordinates equal —00). Therefore, the vector X n is smaller (coordinate- wise) than 
the vector, say Y n , with infinitely many finite coordinates where the last tk coordinates 
equal 0, the next tk-i coordinates equal — dk, ■ • ., t\ coordinates equal — g?2 — ■ ■ ■ — dk, to 
coordinates equal —dk — . . . — d\, t-\ coordinates equal —dk — ... — do, etc. 
Further, we may define vectors Y n for all n (and not only for those with I„(i) = 1) as 
follows: if Tk < n < Tk+i for some k, we obtain the vector Y n by concatenating the vector 
Yr k with n — Tk coordinates equal to zero, i.e. Y n = (. . . , Yr k -i,0, 0, . . . , 0). Then, clearly, 
Y n > X n , coordinate- wise, for all n > 0. 

Since the sequence {T n } is stationary and renewal, the vectors {Y n } form a stationary 
ergodic sequence. For any n, let T n ,o < n be the last time of occurrence of the events 
before or at time n, T n —\ < T n $ the previous such time, and so on. Further, let 
d n j be the distance between particles T n> j_x and T n ^ in the vector Y n . By stationarity, 
the random variable T H) q — n has the same distribution as To and the random vectors 
{{T n ,i — T n ^-i, d n> i)}, i < 0, do not depend on T n $ and are i.i.d., with the same distribution 
as (ti, di). 

Let 60 = E|To|. For e G (0, 1), consider the following events 

H n = {n - r n , < 6 (i + e) n P|{r n ,i - r ft)i _i < 6(1 + e), d n>i > o(l - £)}. (50) 

These events form a stationary ergodic sequence and, by the strong law of large numbers, 
have a positive probability, for any e > 0. Further, one can see that, for n' < n, if the 
events H n i and F^ occur, with T n j = n' for some j < 0, then, for event H n to occur, it 
is sufficient for (50) to hold only for j between i and 0. Namely, 

H n ' n F^ n {T nJ = n'} n H n = H n , n F^ n {T nJ = n'} n E n ,, n (51) 

where the event E n i^ n belongs to the sigma-algebra cr n > >n and does not depend on j. Let 
A n = H n n F^. Taking the union in all j in (51), we obtain condition (12) with A n in 
place of A n - Condition (11), again with A n in place of A n , may be verified similarly. 
Let constants c_j, j > 0, be defined as follows: 

c-j=0 for < j < 6q(1 + e) + 6(1 + e) 
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and, for r > 1, 

c-j=ra(l-e) for (1 + e)(6 + rb) < j < (1 + e)(6 + (r + 1)6). 
Introduce now a second "future" event 

F n = On+1,0 > SUp(Z n+ i _j + C n -j)} n{V t> l,l n +i,vn+i - su P(Wl,-j + c n (52) 
i>0 j>i 

Clearly, for each n, the events H n , Fn and are mutually independent. Further, 

(2) 

the events F„ form a stationary ergodic sequence and, by (48), have a strictly positive 
probability. The meaning of the event -FA is: all locations for "new" particles (with 
numbers greater than n) generated by "old" particles (with numbers less than n) are 
relatively small; thus, given the simultaneous occurrence of the three events H n , F n ^ 

(2) 

and Fn , all future links (starting from time n) are established only between particles 
numbered n, n + 1, n + 2, . . .. 

Let F n = F^nFP and let A n = H n nF n . We may conclude that the stationary sequence 
of events {F n } satisfy properties (Fl) and (F2). Further, an extra intersections with events 

(2) 

F n preserves properties (12) and (11), so the conclusion of Corollary 3 holds. 

Thus the conclusions of Theorem 1 holds. Further, it is easy to verify aperiodicity for the 
times T n defined in Theorem 1, because P(t2 = 1) > 0. Then we may take the random 
functions Ri of Section 2 to be given by Ri(X n+ i, X n ) = (X n _j, . . . ,X n fi), for any fixed 
j, and conclude that the conditions of Theorem 4 and Corollary 5 are satisfied too. The 
result now follows from the latter corollary. □ 



5 Relation to Harris ergodicity and the renovation method 

In this Section, we revisit the basic concept of Harris ergodicity and show that it may be 
considered as a particular case of the approach developed in Section 2. 

It is known (see, e.g., [18, 6, 7]) that a time-homogeneous Markov chain {X n } taking values 
in a measurable state space (X,Bx) may be represented as a stochastic recursion (1) with 
i.i.d. driving sequence {£„} if one assumes Bx to be countably generated. Moreover, 
without loss of generality, one may assume that the random variables £ n are real-valued 
and uniformly distributed on the interval (0, 1). 

Recall the following classical definition. 

Definition. A time-homogeneous aperiodic Markov chain {X n } taking values in a gen- 
eral state space (X,Bx) is Harris ergodic (or Harris positive recurrent) if the following 
conditions hold: 

there exist a set V G Bx, a number < p < 1, an integer m > 1, and a probability 
measure (p on (X,Bx) such that 

(la) for any the first hitting time of the set V, 

t x = t x (V) := mm{n > 1 : X n £ V \ Xq = x} 

is finite a.s., 
(lb) sup x£V Er x < oo, 

and 
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(2) for any x G V, 

P(X m G ■) > M-)- 

Note that frequently set the V is called positive recurrent if the conditions (la)- (lb) hold. 
The following result holds (see e.g. [22]). 

Proposition 15. Assume that the Markov chain {X n } is Harris ergodic. Then there 
exists a unique stationary (invariant) distribution tt, which is also limiting in the sense of 
convergence in the total variation norm: for any Xq = x G X , 

sup \P(X n G B) -7r(JB)| -> 0, as n -> oo. (53) 
BdB x 

Conversely, if (53) holds for any initial value Xq = x G X , then the Markov chain is 
Harris ergodic. 

The "coupling-type" interpretation of the dynamics of a Harris ergodic Markov chain was 
proposed in [2, 24], see also [6, 7]. This may be done as follows: we run a Markov chain 
until it hits set the V (say at time n), then we flip a coin (independently of everything else) 
with probability p of getting head. If this happens, then we say that n + m is the success 
time when the Markov chain "forgets its past", i.e. X n+m has distribution cp which is 
independent of what has happened before time n (but may depend on what has happened 
at times n+1, n+m— 1). If, on the contrary, we get a tail (which occurs with probability 
1— p), we wait for the first time after time n+m when the Markov chain visits V again and 
then flip independently another coin. After a geometric number of trials, we come to the 
success with probability one. It is well-known (see, e.g. [1] or [22]) that the Harris ergodic 
Markov chain may be made regenerative if m = 1 and wide-sense regenerative if m > 2 
(the definitions of regeneration and wide-sense regeneration may be found in Section 2). 
More precisely, let = To < T\ < T2 < . . . be the times of successes. Then the cycle 
lengths Tj+i — Tj are i.i.d. in i > 0, and the cycles (Tj+i — Tj, X^, Xt 4 +i, ■ ■ ■ ,XT i+1 -i) 
are i.i.d. in i > 1 if m = 1, and are 1-dependent and identically distributed (for i > 1) if 
m > 2. The 1-dependence follows since if m > 2, then the set {n + 1, . . . , n + m — 1} is 
non-empty, and if, say, Tj = n + m for some i, then the values X n+ i, . . . , X n+m _i belong 
to the ith cycle, but they also depend, in general, on the value X n+m that belongs to the 
(i + l)st cycle. 

For self-containedness, we recall in more detail the coupling construction of Athreya and 
Ney [2], in the particular case m = 1, see [27] for the general case. Let P(x,B) be the 
transition kernel of the Markov chain. Then, using the condition (2) in the above definition 
of Harris ergodicity, for x G V, 

P(x, B) = MB) + (1 - P ) P ^ B )-W{B) _ _ 

1 — p 

where Q is also a transition probability kernel. 

Now we provide the coupling construction. First, let {a n } be an i.i.d. sequence with 
common distribution P(a n = 1) = 1 — P(a„ = 0) = p. Second, let {£„} be another i.i.d. 
sequence (having, say, a distribution which is uniform on (0, 1)) that does not depend 
on {a n }. Further, let g\ : X x (0, 1) — > X and 52 : V x (0, 1) — > X be two measurable 
functions such that gi(x, ( n ) has distribution P(x, •) and g2(x, Cn) has distribution Q(x, •). 
Finally, let {ipn} be a third independent i.i.d. sequence with distribution ip. 

Then the dynamics of X n is defined as follows: 
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if X n £ V and a n+1 = 1, then X n+1 = ip n+ r, 
if X n G V and a n+ i = 0, then X n+ i = g 2 (^, Cn+i); 
if X n £ V, then X n+1 = g 1 (x, Cn+i)- 
Clearly, X n may be represented as a stochastic recursion with an i.i.d. driving sequence 

Therefore, for m = 1, Proposition 15 may be viewed as a particular case of Corol- 
lary 5, with H n = {X n e V}, F n = {a n+1 = 1}, A n = H n n F n , r n = T n and 
Ri(X Tn+ i, X Tn ) = X Tn+ i. This follows since condition (9) and then the conditions (11) 
and (12) are immediately verified. 

In the case m > 1, we need a slightly more elaborated coupling construction to conclude 
that again Proposition 15 may be viewed as a particular case of Corollary 5. 

6 Comments 

There is an extensive list of other examples, and we mention here a few only. 

First, there are directions where the methodology may be applied directly: Markov chains 
with long memory (e.g. [9, 15, 25]); exited random walks (e.g. [4, 5, 21]); modified random 
walks (e.g. [17]). 

Second, there are models which involve conditioning on the infinite future which — in con- 
trast with examples considered in this paper — has probability zero in the original proba- 
bility space, e.g. [3]. 

A further interesting example of embedded regenerative structure is of shifts of Brownian 
motions, see [20]. 

In the case where the future event F n admits a representation 

k>n 

where F n ^ G (J n ,k satisfy the monotonicity property (9), one can introduce a general 
scheme for "perfect simulation" of the process along the lines of, say, [12]. 

We also comment that our results may be directly extended onto more general models 
where either the elements of the driving sequence {£ n } remain independent but are only 
"asymptotically identically distributed" or where this sequence is regenerative or, more 
generally, converges (in an appropriate manner) to a regenerative sequence. 
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